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FIELD OF THE INVENTION 

The present invention relates to a method and a system for converting text messages into 
streaming audio data, as well for communicating streaming audio data over a network. 

BACKGROUND OF THE INVENTION 

Nowadays, there Is an increasing need for communicating audio and video data via networks. 
One of the requirements to be met by network users is the availability of multi-media 
applications at the user's access equipment. These multi-media applications include audio and 
video software that is used to play, retrieve, and create audio and video content. Needed as 
well is multi-media supporting equipment such as sound-cards, audio-cards, microphones and 
speakers. 

One of tiie developments in recent years with respect to audio applications is tiie availability of 
computer based techniques for converting text data Into speech. With such techniques, text 
data Is translated to audio information by text-to-speech conversion sofhvare. Examples of text- 
to-speech software include Apple Computer's Speech Manager and Digital Equipment 
Corporation's DECTalk. A text-to-speech engine generally comprises a text analyzer, a syntax 
and context analyzer and a synthesis module. Using a text-to-speech engine, users can convert 
text data into audio data on their own equipment such as a personal computer. Via an output 
device, such as a loud speaker, the audio content that is contained by the audio data can be 
heard or interpreted by a human being. 

Also well known nowadays are streaming techniques for retrieving audio data. As an example, 
streaming techniques are used for real-time radio on the Internet Streaming audio refers to 
audio being played 'on ttie fly* as more audio data comes in. In oOier words, the receiving 
system, such as a personal computer, does not wait until the entire audio data input is received. 

As stated before, a necessity for users intending to create and distribute audio data is the 
availability of audio supporting equipment such as a microphone and a sound-card, and audio 
supporting software applications such as a media player. Another necessity is faced when a 
user intends to share witii or communicate to other users audio data over a network. The user 
should then be acquainted with ttie steps to be taken for communicating the generated audio 
:iata and to send it to other users. This requirement can exclude users with no or relatively basic 
know-how relating to multi-media applications from sharing audio data with otiier users. The • 
situation is even more complex for a user if the audio data should be sent to another user, the 
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audio data in association witli other information such as but not limited to, an electronic 
document, a picture or a HTML page. 

A possible way to create, post and retrieve audio data is known from United States Patent 
5 Application No. US 2002/0056351. According to this known method It is possible to post audio 
files to a centrally located server, and to associate audio files with documents. However this 
known method does not include text-to-speech facilities, a user still needs a device such as a 
personal computer that includes specific hardware and supporting software to create audio data 
such as a microphone and an audio card. As a consequence, a user should have the 

10 appropriate knowledge for using, installing, and configuring this type of hardware. Also, for 

purposes where it is more appropriate to convert text data, such as an electronic text document, 
into audio data the known method is not efficacious. This can be the case if a user is a disabled 
person not able to speak or use his or her voice in a proper way. This can also be the case if a 
user Is in a public place while using an access device in order to send audio data to another 

15 user. In the latter case a user may prefer to convert a text message into audio data using a text- 
to-speech application Instead of recording his own voice. Another drawback of the method 
known from United States Patent Application No. US 2002/0056351 is that it does not comprise 
the retrieving of streaming audio data by a user. 

20 AIM OF THE INVENTION 

It is an object of the invention to eliminate the drawbacks of the prior art and to provide a 
method and a system that enables network-users to convert a first type of data into a second 
type of data without local conversion facilities, and to communicate the second type of data to 
25 other network-users where it is received as streaming data. 

SUMMARY OF THE INVENTION 

In accordance of this invention, a method, a platform, and software are disclosed for converting 
30 a first type of data into a second type of data. The conversion of the first type of data takes 
place at a remote conversion server connected to a network accessible for a user. For this 
purpose, the method according to the present invention comprises the steps of: 

> selecting or entering by an originating networi^-user (17) the first type of data (10) , 
35 ■ sending the first type of data (1 0) via a networi< (3) to a service platform (5) 

i . j3JD?'.t!l6J®§fl®L5?ny®r*'D^ *yP®Jl^f!?^J10).'D*° second type of data (15) at 

the service platform (5) 

This step of the method enables users to convert a first type of data, such as text data, into a 
40 second type of data, such as audio data or video data, without locally having available 
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conversion facilities. In tfie case of text data to be converted into audio data, this invention 
solves the problem in the prior art that audio supporting equipnnent or text-to«speech facilities 
should be available locally. The text data can be a text message that is sent by a netA^ork user 
via a network to a server connected to the network. Additionally or optionally, the text data can 
5 be a part of an electronic text document or any other alphanumeric source. The network 
accessible for the user can be the Internet, or any type of public or private network. 

The method according to the invention can also include the step to send the second type of 
data as streaming data to another user via a server connected to the network, in the case of 

10 text data being converted into audio data, this means that, together with the remote text-to- 
speech facilities of the first step, upstream text data is received downstream as streaming audio 
data. To accomplish this, a user sends the text data and an identification of the addressed user 
over the network to interacting servers, database and other computer programs connected to 
the network. The interacting servers, databases and other computer programs process the input 

15 received from the user resulting in streaming audio data to be received by the addressed user. 
An identification code can be used to identify the text data. 

The method according to the invention can further Include the step to associate the second type 
of data with a file or any other type of electronic document including, but not limited to, text 

20 documents, images and HTML documents. If the second type of data is audio data, it can be 
associated with a HTML document to help to interpreted what can be seen on the HTML 
document If the second type of data is video data, it can be associated with a text document to 
visualize what can be found in the text document. A file can be selected by a user from a 
collection of files centrally available at a server connected to the network, or from a collection of 

25 files locally available at the access device of the user. 

With tiie functionality of the service platform (5). users are able to create and distribute a certain 
type of data without having available the required facilities for this locally. 

30 BRIEF DESCRIPTION OF THE DRAWING FIGURE 

The foregoing aspects and many of attendant advantages of this invention will become better 
understood by reference to the following detailed description, when taken in conjunction with the 
accompanying drawing, wherein: 

35 

FIG, 1 is a block diagram illustrating the components involved if tiie first type of data is text data 
(10) and the second type of data is audio data (15). 
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EXEMPLARY EMBODIMENTS 

For the purpose of teaching of the invention, preferred embodiments of the method and devices 
of the invention are described in the sequel. It will be apparent to the person sl<illed in the art 
5 that other alternative and equivalent embodiments of the invention can be conceived and 
reduced to practice without departing form the true spirit of the invention, the scope of the 
invention being limited only by the appended claims as finally granted. 

FIG.1 shows an embodiment of the invention in the case of converting text data (10) into audio 
10 data (15). Referring to FIG. 1 there is a network (3) that connects network-users. The network 

(3) can be a fixed or mobile network. The network (3) may be a public network, such as the 
Internet, or a private network. The network may be a non-secure network or a network that is 
perceived as being non-secure, although secure networks are not excluded in relation to this 
invention. The network (3) can be facilitated by a service provider, such as an Internet service 

15 provider, although network (3) also can be facilitated by an organization operating accessibility 
to remote sites for specific groups of customers. In the latter case the customer is able to 
access directly, i.e. without using the Internet, one or more remote locations. 

A server (4) is connected to the network (3). There may be many different servers (4), 
20 geographically or functionally separated from each other and each managed, controlled and 
exploited by different parties. The server (4) in the embodiment depicted in FIG.1 is a 
microprocessor-based system comprising a processing unit and a memory although many other 
features, facilities and components may be part of the server (4) too. In the memory of the 
server (4) are one or more application programs stored that execute on the CPU of the server 
25 (4), The server (4) can be a system operating under UNIX, NT or any other related operating 
system. An application residing at the server (4) may be a computer program such as a WWW 
server, although the present invention does not exclude applications that are not related to 
Internet technology. As an altematlve for being accessible via the Internet, the server (4) can be 
part of a private domain accessible for a closed user group. In the latter case, the server (4) 
30 may be hosting IP based non-IP based applications and Information. The server (4) and the 

applications residing on it may be operated and exploited by an electronic merchant. The server 

(4) and the sen/ice platform (5) may be located at the same physical location. 

An originating network-user (17) is connected to the network (3). The originating network user 
35 (17) is a user that initiates the process of sending streaming audio data to a receiving network- 

. - - Jiset(18). Jhe.origln^lng netwprkrJJs^^^ access deyice.(l).for^ccessfng 

the network (3). The originating access device (1) is a device for accessing a mobile or fixed 
network, such as a telephone, a laptop or a personal computer. If the originating access device 
(1) is a telephone, it preferably is a touch-tone telephone that is able to send and receive short 
40 messages (SM's). An IP telephone may be used in connection to the present invention too. 
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Wireless devices are also taken into account with regard to this invention, such as bluetooth 
supporting devices. The originating access device (1) may also be part of a local area network. 
Peripheral devices like a modem and a mouse are not shown. The originating access device (1) 
has limited or in some cases no facilities available for retrieving, playing, recording and sending 
5 audio data. Additionally, the originating network-user (1 7) could have a limited understanding of 
using or Installing multi-media applica«ons and hardware on the originating access device (1). 
So even if ttie appropriate multHnedla applfcations and hanJware are available on the 
originating access device (1), the originating networi<-user (17) may not able to retrieve, record, 
send are play audio data, because the originating networi<-user (17) Is not femillar with the 
1 0 usage of these multi-media applications and hardware. The physical connection between the 
originating access device (1) and the networic (3) can be through a modem and a telephone 
line, a networking device and a leased line, or any types of wireless connection means. The 
details of the type of connection between the originating access device (1) and the networic (3) 
are of no consequence in the present invention. 

15 

Again with reference to Fig. 1 the dashed line relates to the service platfonn (5). The service 
platform (5) can be operated and exploited by a service provider. The service platform consists 
of a number of entities, which are discussed hereafter. The entity where the conversion takes 
place of the text data (10) into audio data (15) is a TTS (text-to-speech) manager (6). which is a 

20 CGI (Common Gateway Interface) program; The TTS manager (6) has access to a storage 

means (7). A media encoder (8) is connected to the TTS manager (6). The media encoder (8) is 
an application that generates one or more audio data streams simultaneously based on the 
input that is received from the TTS server (9). The TTS server (9) comprises software that 
converts text into audio data (16). The TTS manager (6). the media encoder (8) end the TTS 

25 server (9) may be hosted by one physical system or may be each be hosted by a separate 
physical system. Usually but not necessarily, the service platfonn (5) is protected against 
threats originating fix)m the networic (3) by means of a fire-vt/all (not shown). 

Refening to Fig. 1 the originating networi<-user (17) accesses the server (4) via the network (3). 

30 If the application on the server (4) is a website, the originating network-user (1 7) can Invoke the 
TTS service through a HTML hyperiink. Access to the functionality of the TTS platform (5) Is 
provided via a payment mechanism. The payment mechanism can be based upon the usage of 
a credit card or it can be any other payment mechanism, for instance based on dialing a 0800 
telephone number. The originating network-user (17) can construct a text data (1 0) and send 

35 the text data (10) to ttie server (4). Creating the text data (1 0) can be done in many different 
ways. The text data (10) can be created by the originating network-user (17) by using a text 
editor, an e-mail program, a browser program or, in case ttie originating access device (1) is a 
telephone, simply by entering the text data (10) via a user-interface. A destination address (19) 
to Identify the receiving networtc-user (18) is sent by the originating networtc-user (17) together 

40 with the text data (10) to the server (4). The destination address (19) can be an e-mail address 
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or any type of identification number. The destination address (19) can be sent simultaneously 
along with the text data (10). or can be sent before or after sending the text data (10). 

Optionally or alternatively, the originating network-user (17) can associate an object with the 
5 text data (1 0). The object can be an image according to any type of format, such as but not 
limited to the JPEG or GIF format. The object can also be a video sequence according to any 
type of fonnat. streaming or non-streaming, such as MPEG and VIVO. The object can also be 
an HTML document or any kind of file, including text documents and graphical files. It is 
emphasized that these examples are provided merely for illustration and not limitation. 

10 

After the text data (10) is received by the server (4). the text data (10) will be sent to the TTS 
manager (6). In an embodiment according to this invention there can be sent a code (11) 
together with the text data (10) to the TTS manager (6). This code (11) can be used to identify 
the server (4) that has sent the text data (10). Based on the code (11) accounting can take 
15 place between the service provider that operates the service platform (5) and the electronic 
merchant that operates the server (4). 

After receiving the text data (10) and the code (1 1) the TTS manager (6) performs a validity 
check on the code (11). If the code (1 1) is valid, the TTS manager (6) stores the text data (10) 
20 in the storage means (7). The TTS manager (6) also generates an activation code (12) that is 
stored also in the storage means (7). The activation code (12) may be a unique code. The 
activation code (12) refers to the text data (1 0) via a link, pointer or any other mechanism to 
associate the text data (10) with the activation code (12). 

25 The TTS manager (6) sends a reference address, such as a URL (Universal Resource 

Location), with the activation code (12) as a parameter to an application, such as a web server, 
at the sen/er (4). The reference address refers to the TTS manager (6), and is used to indicate 
the location of the TTS manager (6). If the systems described in this disclosure are based on IP 
related technology, the reference address represents an IP address. Alternatively, the reference 

30 address represents some other Identification of a network entity or application. 

At the server (4) a webpage is being created that contains the reference address to the TTS 
manager (6). The webpage also contains a media player that can be started by the receiving 
network-user (18). The server (4) also sends an e-mail message (14) containing another 
35 reference address to the receiving network-user (18). The other reference address refers to the 

webpage being created by jhe server„(4). After receiving the.e-mail_message_(1 4)^Jthe receiving- 

network-user (18) can access the webpage by selecting the reference address (or clicking the 
URL) received in the e-mail message (14). Having accessed the webpage, the receiving 
network-user (18) can start the media player resulting in sending the activation code (12) to the 
40 TTS manager (6) and consequently activating the TTS manager (6). 
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After having received the activation code (12), the TTS manager (6) checl<s the validity of the 
activation code (12). If the activation code (12) is valid, the TTS manager retrieves the 
corresponding text data (10) from the storage means (7). The TTS manager (6) sends the text 
5 data (10) to a TTS server (9). where the text data (10) is converted into an audio data (16). It is 
not necessarily to store the audio data (15) in the storage means (7), although in some other 
embodiments of the present invention it can be possible to store the audio data (15) before 
being processed by a media encoder (8). Avoiding storing the audio data (15) in the storage 
means reduces the required memory capacity, and avoids costs relating to the usage of the 
1 0 software residing at the TTS server (9) like license fees. The audio data (1 5) is sent to the 
media encoder (8) resulting in an audio data stream (16). The audio data stream (16) can be 
sent to the receiving network-user (18), where the audio data stream (16) is played using the 
media player available for the receiving network-user (18). The end of the process can be 
determined using different techniques, such as the detection of a period of inactivity. 
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CLAIMS 



1 1 10. 2002 



10 

2. 

15 

3. 
4. 

20 

5. 
6. 

25 

7. 

30 

8. 

35 9. 



Method for converting a first type of data (10) into a second type of data (15) comprising the 
steps of: 

• selecting or entering by an originating networl^-user (1 7) the first type of data (1 0) , 

■ sending the first type of data (1 0) via a network (3) to a service platform (5) 

■ and thereafter converting the first type of data (1 0) into the second type of data (1 5) at 
the service platform (5) 

Method according to claim 1 , wherein said first type of data (1 0) Is sent to the service 
platform (5) via a server (4) connected to the network (3) 

Method according to claim 1 or 2, wherein said network (3) is a mobile network. 

Method according to claim 1 , 2 or 3, wherein said service platform (5) and said server (4) 
are located at the same physical location. 

Method according to any of the preceding claims , wherein said second type of data (15) is 
sent as a data stream (16) to a receiving network-user (18) 

Method according to of the preceding claims, wherein a payment mechanism is used to 
enable the originating network-user (17) or the receiving network user (18) for using the 
service platform (5). 

Method according to any of the preceding claims, wherein said first type of data (10) is 
associated with an electronic file or any type of electronic document 

Method according to any of the preceding claims, wherein the network (3) to which the 
originating network-user (17) is connected is not the same as the network (3) to which the 
receiving network-user (18) is connected. 

Method according to any of the preceding claims, wherein the originating network-user (17) 
uses an identification code before making use of the service platform (5). 



10. Method according to any of the preceding claims, wherein a code (11) is used to identify the 
server (4). 



11 Platform for converting a first type of data (10) into a second type of data (15), the platform 
comprising: 

■ means for selecting or entering by an originating network-user (17) the first type of data 
5 (10). 

■ means for receiving the selected or entered first type of data (1 0) via a network (3). 

■ means for thereafter converting the first type of data (10) into the second type of data 
(15). 

10 12. Platform according to claim 5, wherein said first type of data (10) is received via a server (4) 
connected to the network (3) 

13. Platform according to claims 5 and 6, wherein said second type of data (15) is sent as a 
data stream (16) to a receiving network-user (18) 

15 

14. Software for converting a first type of data (10) into a second type of data (15), the 
software comprising: 

■ modules for selecting or entering by an originating network-user (17) the first type of 
20 data (10). 

■ modules for receiving the selected or entered first type of data (1 0) via a network (3) 

■ modules for thereafter converting the first type of data (10) into the second type of data 
(15). 

25 
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ABSTRACT 

A method, a platform and software are disclosed for converting a first type of data (10) into a 
second type of data (15). The first type of data (10) can be sent by an originating network-user 
(17) to a remote service platform (5) connected to a network (3). The conversion of the first type 
of data (10) into the second type of data (15) takes place at the remote service platform (5). The 
originating network-user (17) can address a receiving network-user (18) to whom the second 
type of data (15) can be sent The receiving network-user (18) receives the second type of data 
(15) as a data stream (16). The originating network-user (17) can also associate the first type of 
data (10) with an electronic file. The receiving network-user (18) receives the electronic file 
together with the data stream (16). With the functionality of the service platform (5), users are 
able to create and distribute a certain type of data without having available the req ulred facilities 
for this locally. 
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